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SYSTEM AND METHOD FOR DISPLAYING VIDEO STREAMS RANKED 

BY USER-SPECIFIED CRITERIA 

5 Inventors: 

Paul G. Allen, Michael Lee, James K. Okamoto 

BACKGROUND OF THE INVENTION 

FIELD OF THE INVENTION 
10 The present invention relates generally to interactive television systems. 

More specifically, the present invention relates to systems and methods for 
displaying video streams ranked by user-specified criteria. 

DESCRIPTION OF RELATED BACKGROUND ART 

In recent years, a growing number of personal computers and interactive 
15 television systems are equipped with digital video cameras. Such cameras may be 
configured as "web cameras" or "webcams." A webcam captures a stream of video 
images and broadcasts the images via the Internet to any requesting Web browser 
(e.g., Microsoft Internet Explorer®). 

In the early days of the Internet, webcams were used to monitor coffee pots 
20 and fish tanks. Today, thousands of webcams are used in such diverse and 
important applications as monitoring freeway traffic (e.g., "traffic cams") and 
monitoring children at day care centers (e.g., "kiddie cams" or "cradle cams"). 

Because of the many video options available, a user may wish to view the 
output of many webcams simultaneously. In fact, a user may desire to watch the 



output of more webcams than can be feasibly displayed at the same time on a 
computer monitor or television display. 

Of course, not every webcam provides the same degree of interest to a user 
all of the time. For instance, some webcams may only be of interest at certain times 
5 of the day, e.g., traffic cams during rush hour. Other webcams may be interesting 
only when the scene being displayed changes. For example, where a webcam 
monitors an individual's empty home, a change in scene created by a burglar 
moving into the webcam's field of view would be of considerable interest. 

Unfortunately, if the webcam of interest is not currently being displayed, a 
10 user may miss an important event. Even if the webcam is being displayed, a user 
cannot typically focus on more than a few webcams simultaneously. Thus, the user 
may still miss an important event simply because he or she is focused on another 
webcam. 

Accordingly, what is needed is a system and method for allowing a user to 
15 simultaneously monitor the output of multiple webcams. What is also needed is a 
system and method of ranking video streams generated by webcams according to 
user-defined criteria. Indeed, what is needed is a system and method for drawing a 
user's attention to video streams of the highest potential significance based on the 
user-defined criteria. 

20 
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BRIEF DESCRIPTION OF THE DRAWINGS 
Non-exhaustive embodiments of the invention are described with reference to 
the figures, in which: 

FIG. 1 is a block diagram of a system for transmitting and simultaneously 
displaying multiple video streams; 

FIG. 2 is an illustration of an interactive television system including a remote 
control, a camera, a set top box, and a television; 

FIG. 3 is a block diagram of physical components of a set top box; 

FIG. 4 is a block diagram of logical components of a system for displaying 
video streams ranked according to user-specified criteria; 

FIG. 5 illustrates one possible layout for ranked video streams on a display 

device; 

FIG. 6 illustrates a plurality of ranked video streams being displayed in a grid 

format; 

FIG. 7 illustrates the promotion of a video stream to a higher rank; 

FIG. 8 illustrates one video stream being enlarged relative to other video 
streams; and 

FIG. 9 shows a plurality of ranked video streams being displayed in a ticker 

format. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
The present invention solves the foregoing problems and disadvantages by 
providing a system and method for video streams ranked according to user-specified 
5 criteria. In one embodiment, a terminal in a network receives and simultaneously 
displays a number of video streams. Each video stream may be generated by a 
camera associated with a different terminal in the network. 

The video streams may be displayed on the terminal in various formats, such 
as a grid format or a ticker format. For instance, in the grid format, the video 
10 streams are arranged in rows and columns. In the ticker format, the video streams 
move across the terminal in a carousel fashion (e.g., like a stock ticker). Any 
number of video streams may be displayed in either format, limited only by 
bandwidth considerations. Accordingly, a user may monitor a number of video 
streams simultaneously. 

15 The displayed video streams may be ranked according to a set of user- 

specified ranking criteria. For example, a video stream may also be promoted to a 
higher rank when a scene change is detected. Alternatively, the video streams may 
be ranked at periodic intervals according to the recency or frequency of scene 
updates. 

20 In some cases, video streams may receive a higher rank depending on the 

date or time. For example, a video stream from a traffic cam may be promoted to a 
higher rank during rush hour. Likewise, ranking may be based on external events 
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and data. For instance, if a user's calendar has an entry for air travel on a particular 
day, webcam views for airport traffic and weather may be promoted to a higher rank. 

Preferably, the ranked video streams are displayed on the terminal such that 
the video stream of highest rank is brought to the attention of the user. For example, 
in a grid layout, the video streams may be displayed in order of rank, with the most 
highly ranked video stream being shown in the upper left-hand corner of the display 
screen. Of course, various other arrangements of video streams that indicate a 
ranking or hierarchy are within the scope of the invention. 

In certain embodiments, only video streams having at least a particular rank 
may be shown on the display screen. This is advantageous where there are too 
many video streams to feasibly display at the same time. Moreover, a user's 
attention may be drawn to highly ranked video streams in other ways. For example, 
a video stream of highest rank may be enlarged relative to the other video streams. 

In a "ticker" format, video streams move across the display screen a carousel 
fashion (e.g., like a stock ticker). In such an embodiment, video streams of a higher 
rank are displayed closer to the beginning position of the ticker than video streams 
of a lower rank. Accordingly, a user's attention is quickly drawn to potentially 
significant video streams without needing to focus every video stream being 
displayed. 

Reference throughout this specification to "one embodiment" or "an 
embodiment" means that a particular feature, structure, or characteristic described in 
connection with the embodiment is included in at least one embodiment of the 



present invention. Thus, appearances of the phrases "in one embodiment" or "in an 
embodiment" in various places throughout this specification are not necessarily all 
referring to the same embodiment. 

Furthermore, the described features, structures, or characteristics may be 
5 combined in any suitable manner in one or more embodiments. In the following 
description, numerous specific details are provided, such as examples of 
programming, user selections, network transactions, database queries, database 
; J| structures, etc., to provide a thorough understanding of embodiments of the 

1^ invention. One skilled in the relevant art will recognize, however, that the invention 

vJ 10 can be practiced without one or more of the specific details, or with other methods, 
r " ! components, materials, etc. In other instances, well-known structures, materials, or 
" operations are not shown or described in detail to avoid obscuring aspects of the 

S invention. 

Throughout the following disclosure, the term "coupled" may be used to refer 
15 to components that are either directly connected to one another or linked by one or 
more other components. Thus, as used herein, the term "coupled" may be 
synonymous with "in electrical communication with" or simply "in communication 
with." 

Referring now to FIG. 1, there is shown system 100 for transmitting and 
20 displaying video streams using a communication network 102. The network 102 
may be embodied, for example, a broadband cable network or a direct satellite 
broadcast (DBS) network. The network may also communicate with or be embodied 
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as other networks, such as a telephone network 104, or a packet-driven network 
(e.g., the Internet 106). 

In one configuration, the system 100 includes a plurality of set top boxes 
(STBs) 108 located, for instance, at customer homes. Generally, an STB 108 is a 
5 consumer electronics device that serves as a gateway between a customer's 
television 110 and the network 102. In alternative embodiments, an STB 108 may 
be embodied more generally as a personal computer 112, an advanced television 
110 with integrated STB functionality, or another type of client terminal. 

An STB 108 receives encoded video streams and other information from the 
w network 102 and decodes the same for display on the television 1 10 or other display 
device (such as a computer monitor, flat panel display, or the like). As its name 
implies, an STB 108 is typically located on top of, or in close proximity to, a 
television 110. 

An STB 108 may be coupled to a video camera 114, which captures video 
15 streams for the STB 108. The video camera 114 may be embodied as a digital 
video camera having a charge-coupled device (CCD) array. Digital video cameras 
are well known in the art, such as the Logitech QuickCam Pro USB®, available from 
Logitech, Inc. of Fremont, California. 

The video camera 114 may be configured as a "webcam", which captures a 
20 continual stream of video images and broadcasts the images via a communication 
network, such as the Internet 106, to a requesting client module, such as a Web 
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browser. However, the term "webcam" should not be construed as being limited 
only to the World Wide Web component of the Internet. 

In certain embodiments, the video camera 114 may include an integrated 
microphone (not shown) for capturing audio signals. Alternatively, the microphone 
5 may be integrated with the STB 108, the remote control 118, the television 110, or 
the like. 

The following discussion refers primarily to the capture and transmission of 
video streams. However, those skilled in the art recognize that the term "video 
streams" also include or are associated with audio signals. Thus, where video 
10 streams and video components are specifically illustrated, audio signals and audio 
components are implied. 

As discussed in further detail below, the STB 108 may convert video streams 
generated by the video camera 1 14 into various formats for transmission through the 
network 102. The STB 108 may transmit video streams to one or more other STBs 
15 108, to a personal computer 112, or to another type of terminal. 

It should be noted, however, that video streams are not limited to live video 
generated by webcams. For example, in one embodiment, video streams may also 
include broadcast television programming generated by content providers, such as 
television stations 115. 

20 In one embodiment, each STB 108 is coupled to the network 102 via a 

broadcast center 116. In the context of a cable network, the broadcast center may 
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take the form of a head-end, which is generally a centrally-located facility where 
television programs are received from a local cable TV satellite downlink or other 
source and packaged together for transmission to customer homes. In one 
configuration, a head-end also functions as a Central Office (CO) in the telephone 
5 industry, routing video streams and other data to and from the various STBs 108 
serviced thereby. 

The broadcast center 116 may also embodied as a satellite broadcast center 
within a direct satellite broadcast (DBS) system. A DBS system may utilize a small 
18-inch satellite dish (which is an antenna for receiving a satellite broadcast signal). 
10 Each STB 108 may be integrated with a digital integrated receiver/decoder (IRD), 
which separates each channel, and decompresses and translates the digital signal 
from the satellite dish so that the television 110 can show it. The remote control 118 
may then be used to control the IRD with the integrated STB 108, and optionally the 
television 110. 

15 Programming for a DBS system may be distributed, for example, by multiple 

high-power satellites in geosynchronous orbit, each with multiple transponders. 
Compression (e.g., MPEG) is used to increase the amount of programming that can 
be transmitted in the available bandwidth. 

The broadcast centers 116 may be used to gather programming content, 
20 ensure its digital quality, and transmit the signal up to the satellites. Programming 
may come to the broadcast centers 116 from content providers (CNN, ESPN, HBO, 
TBS, etc.) via satellite, fiber optic cable and/or special digital tape. Satellite- 
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delivered programming is typically immediately digitized, encrypted and uplinked to 
the orbiting satellites. The satellites retransmit the signal back down to every earth- 
station, e.g., every compatible DBS system receiver dish at customers' homes and 
businesses. 

5 Some programs may be recorded on digital videotape in the broadcast center 

1 16 to be broadcast later. Before any recorded programs are viewed by customers, 
technicians may use post-production equipment to view and analyze each tape to 
ensure audio and video quality. Tapes may then be loaded into a robotic tape 
handling systems, and playback may be triggered by a computerized signal sent 
w from a broadcast automation system. Back-up videotape playback equipment may 
ensure uninterrupted transmission at all times. 

Regardless of the nature of the network 102, broadcast centers 116 may be 
coupled directly to one another or through the network 102. In some cases, 
broadcast centers 116 may be connected via a separate network, one particular 
15 example of which is the Internet 106. Two or more STBs 108 may also be served by 
the same broadcast center 1 1 6. 

Transmission between broadcast centers 116 may occur, for example, (i) via 
a direct peer-to-peer connection between broadcast centers 116, (ii) upstream from 
a first broadcast center 116 to a network 102 and then downstream to a second 
20 broadcast center 116, (iii) via the Internet 106, or (iv) via a telephone network 104. 
For example, a first STB 108 may send a video transmission upstream to a first 
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broadcast center 116, then to a second broadcast center 116, and finally 
downstream to a second STB 108. 

In one configuration, video streams are distributed in an encoded format, 
such as MPEG (Moving Picture Experts Group). Various MPEG standards are 
known, such as MPEG-2, MPEG-4, MPEG-7, and the like. Thus, the term "MPEG," 
as used herein, contemplates all MPEG standards. Moreover, other video 
encoding/compression standards exist other than MPEG, such as JPEG, JPEG-LS, 
H.261, and H.263. Accordingly, the invention should not be construed as being 
limited only to MPEG. Of course, proprietary video encoding formats may be used 
within the scope of the invention. 

Each STB 108 may be distinguished from other network components by a 
unique identifier, number, code, or address, examples of which include an IP 
(Internet Protocol) address or a MAC (Media Access Control) address. Thus, video 
streams and other information may be transmitted from the network 102 to a specific 
STB 108 by specifying the corresponding address, after which the network 102 
routes the transmission to its destination using conventional techniques. 

The network 102 is also preferably coupled to the Internet 106 to provide 
access thereto by the STBs 108. The Internet 106 is a "network of networks" and is 
well known to those skilled in the art. Communication over the Internet 106 is 
accomplished using standard protocols, such as TCP/IP (transmission control 
protocol/Internet protocol) and the like. 
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A remote control 118 is provided, in one configuration, for convenient remote 
operation of the STB 108 and/or the television 110. The remote control 118 may 
use infrared (IR), radio frequency (RF), or other wireless technologies to transmit 
control signals to the STB 108 and the television 110. Other remote control devices 
5 are also contemplated, such as a wired or wireless mouse (not shown), a keyboard 
(not shown), or the like. 

FIG. 2 is an illustration of an interactive television system 200, including a 
remote control 1 18, a camera 1 14, a set top box 108, and a television 1 10 (or other 
display device). As noted, the remote control 1 18 is provided for convenient remote 
10 operation of the STB 108 and television 110. Preferably, control signals are 
transmitted from a wireless transmitter 202 in the remote control 118 to a wireless 
receiver 204 in the STB 108 and/or the television 110. 

In the depicted embodiment, the remote control 118 includes a plurality of 
buttons or similar controls. For instance, the remote control 118 may include a 
15 power button 206, an up arrow button 208, a down arrow button 210, a left arrow 
button 212, a right arrow button 214, a "Select" button 216, an "OK" button 218, 
channel adjustment buttons 220, volume adjustment buttons 222, alphanumeric 
buttons 224, and the like. The functions of certain of the above-identified buttons will 
be discussed in greater detail below. 

20 FIG. 3 is a block diagram of physical components of a set top box 108 

according to an embodiment of the invention. The STB 108 may include, in one 
configuration, a network interface 302 for communicating with the network 102 via 
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the broadcast center 116. The interface 302 may include conventional tuning 
circuitry for receiving MPEG (Moving Picture Experts Group) packets for a selected 
television channel. The interface 302 may also include conventional cable modem 
circuitry for sending or receiving other types of data. For example, the interface 302 
5 may conform to the DOCSIS (Data Over Cable Service Interface Specification) or 
DAVIC (Digital Audio-Visual Council) cable modem standards. 

In one configuration, one or more frequency bands (for example, from 5 to 30 
MHz) may be reserved for upstream transmission. Digital modulation (for example, 
quadrature amplitude modulation or vestigial sideband modulation) may be used to 
10 send digital signals in an upstream transmission. 

Of course, upstream transmission may be accomplished differently for 
different networks. Alternative ways to accomplish upstream transmission include 
using back channel transmission, which is typically sent via an analog telephone 
line, ISDN, DSL, or other techniques. For example, in one embodiment, 
15 communication with a telephone network 104 may also be accomplished via a 
separate telephone modem 304, such as a DSL (digital subscriber line) or analog 
telephone modem. 

The STB 108 also preferably includes a codec (encoder/decoder) 306. The 
codec 306 serves to encode audio/video signals into a network-compatible data 
20 stream for transmission over the network 1 02. The codec 306 also serves to decode 
a network-compatible data stream received from the network 102. As depicted, the 
codec 306 may be implemented as a hardware component. Alternatively, or in 
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addition, software encoding and decoding may be used. The codec 306 may use 
various algorithms, such as MPEG, for encoding and decoding. The codec 306 may 
be directly or indirectly coupled to the video camera 114 in order to encode a 
captured video signal. 

5 The STB 108 may further include a memory device 308, such as a random 

access memory (RAM), to store data for temporary use. Similarly, a read-only 
memory (ROM) may be provided for storing more permanent data, such as fixed 
code and configuration information. 

In one implementation, an audio/video (AN) controller 310 is provided for 
10 converting decoded digital audio/video information into analog or digital signals for 
display/playback on the television 110 or other display devices. The AN controller 
310 may be implemented using one or more physical devices, such as separate 
graphics and audio interfaces. Preferably, the AN controller 310 includes graphics 
hardware for performing bit-block transfers (bit-blits) and other graphical operations. 

15 The STB 108 may also include a storage device 312, such as a hard disk 

drive, or the like. The storage device 312 may record encoded television broadcasts 
and retrieve the broadcasts at a later time for decoding by the codec 306 and display 
by the AN controller 310. Thus, the storage device 312 may be used in PVR 
(personal video recording) applications, such as time shifting, pausing (buffering) live 

20 video, etc. 

The storage device 312 may also be used, in various embodiments, to store 
viewer preferences, parental lock settings, electronic programming guide (EPG) 
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data, programming preferences, passwords, e-mail messages, and the like. In one 
implementation, the storage device 312 also stores an operating system (OS) for the 
STB 108, such as Windows CE® or Linux® 

As previously noted, the STB 108 may include a wireless receiver 204 for 
5 receiving control signals from the wireless transmitter 202 of the remote control 118. 
The wireless transmitter 202 may rely on various wireless technologies, such as IR 
orRF. 

J A CPU 314 controls the operation of the STB 108, including the other 

m components thereof, which are coupled to the CPU 314 via a bus 316. The bus 316 
CI 10 serves as a communication channel between many components (e.g., CPU 314, 
; ri Interface 302, storage device 312) of the STB 108. The CPU 314 may be embodied 

g /* as a microprocessor, a microcontroller, a digital signal processor (DSP) or other 

S device known in the art. For example, the CPU 314 may be embodied as an Intel® 

x86 microprocessor. The CPU 314 may perform various logical and arithmetic 
15 operations in response to control signals generated by the remote control 118. 

Of course, FIG. 3 illustrates only one possible configuration of an STB 108. 
Those skilled in the art will recognize that various other architectures and 
components may be provided within the scope of the invention. In addition, various 
standard components of a typical STB 108 are not illustrated in order to avoid 
20 obscuring aspects of the invention. 

FIG. 4 is a block diagram of logical components of system 400 for displaying 
a plurality of video streams 401 ranked according to user-defined criteria. The 
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depicted logical components may be implemented using one or more of the physical 
components shown in FIG. 3. Additionally, or in the alternative, various logical 
components may be implemented as software modules stored in the memory 308 
and/or storage device 312 and executed by the CPU 314. Those skilled in the art 
5 will recognize that various illustrated components may be combined together or 
integrated with standard components in various configurations without departing 
from the scope or spirit of the invention. 

As shown in FIG. 4, a plurality of video streams 401 are generated by video 
cameras 114 coupled to terminals within a network 102. The terminals may be 
10 embodied as STBs 108, personal computers 112, or the like. Also, in one 
embodiment, a video stream 401 may be a broadcast television program generated 
by a television station 115. The video streams 401 may be conveyed to an STB 108 
via one or more broadcast centers 116. 

In one embodiment, the STB 108 includes a stream reception component 
15 402, which receives the video streams 401. As noted above, the video cameras 
114 may be configured as webcams, which comprise hardware and/or software for 
providing video streams 401 to a requesting client module, such as a Web browser. 
In such an embodiment, the stream reception component 402 may be embodied as 
the component of a Web browser that is responsible for receiving and processing 
20 video streams 401 received from webcams. However, the stream reception 
component 402 need not be implemented in the context of a Web browser. 
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The particular video streams 401 received by the stream reception module 
402 are preferably user-selected. For example, the user may specify a network 
address of each camera-equipped terminal for which a video stream 401 is desired. 
The stream reception component 402 then interacts with the selected terminal to 
5 receive the video stream 401 using standard protocols well known to those skilled in 
the art. 

In one implementation, the STB 108 also includes a stream ranking 
component 404. The stream ranking component 404 ranks the video streams 401 , 
or at least a portion thereof, according to user-specified ranking criteria 405. As 
10 explained in greater detail below, the rankings determine how (and possibly 
whether) particular video streams 401 are displayed on the television 110 or other 
display device. For instance, video streams 401 may be displayed on the television 
110 in order of rank, allowing a user to easily focus on the webcams of greatest 
significance. 

15 In one embodiment, the video streams 401 are ranked according to recency 

of scene changes. For instance, a video stream 401 may be promoted to a higher 
rank when a scene change is detected. This is advantageous when a user wishes 
to know when someone or something enters the field of view of a webcam, such as 
a burglar, etc. 

20 Scene changes may be detected in numerous ways. For example, an 

MPEG-2 encoded video stream 401 does not generally transmit complete video 
frames. Rather, key video frames are periodically sent followed by a series of 
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changes or updates. These changes or updates may be detected and quantified 
using techniques known in the art. Thus, where a webcam is monitoring an empty 
room, a person entering the field of view of the camera would create a detectable 
change in the video stream 401 produced by that webcam. Naturally, other video 
5 formats and transmission protocols may lend themselves to a similar ranking 
technique. 

In one implementation, each of the video streams 401 may be ranked 
according to the recency of the last significant scene change. Alternatively, the 
video streams 401 may be ranked according to the frequency of scene changes. In 
10 still other embodiments, a single video stream 401 is promoted to the highest rank in 
response to a scene change being detected. 

In alternative embodiments, different ranking criteria 405 may be used. For 
example, a video streams 401 may be assigned a higher rank (and thus be 
displayed or displayed more prominently) depending on the particular time of day 
15 and/or day of the week. For example, a video stream 401 generated by a webcam 
monitoring freeway traffic may be promoted to a higher rank during rush hour. 

In yet another alternative, video streams 401 may be ranked according to 
external events and/or data. For instance, a calendar 407 from a user's personal 
information manager (PIM), such as Microsoft Outlook®, may include an entry for air 
20 travel on a particular day. In one embodiment, video streams 401 related to airport 
traffic in the departure city and weather in both the departure and arrival cities may 
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be given a higher priority on the day of travel. Of course, a variety of other ranking 
criteria 405 based on external events and data are possible. 

In addition, a user may specify the ranking of a video stream 401. For 
example, a user may specify that a video stream 401 from a webcam depicting his 
5 home has the highest rank, particularly during the hours at which his or her children 
are at home. User specification of ranking may be implemented through menus or 
other standard user interface mechanisms. 

As noted before, the video streams 401 may also include broadcast television 
programming. In certain embodiments, video streams 401 may be ranked according 
10 to popularity, e.g., by how many STBs 108 are receiving a particular video stream. 
Viewing statistics could be maintained by the television stations 115, television 
networks, or a centralized server (not shown). 

In one embodiment, ranking occurs continuously or on the occurrence of a 
particular event, e.g., with the detection of a scene change in a video stream 401 . In 
15 alternative embodiments, ranking occurs at periodic intervals, e.g., every 2 minutes. 
Any of the above-described ranking criteria 405 may be combined in a suitable 
manner. For example, a secondary ranking criterion 405 may be designated to 
break ties resulting from the application of a primary ranking criterion 405. 

The stream ranking component 404 may be implemented as a software 
20 module stored in the memory 308 and/or storage device 312 and executed by the 
CPU 314. For example, the ranking component 404 may be embodied within a 
"plug-in" application for a Web browser. 
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In one embodiment, the STB 108 also includes a stream display component 
406, which simultaneously displays the video streams 401 (or a subset thereof) on a 
display device, such as a television 110. The stream display component 406 may 
be implemented, in certain embodiments, as the component of a Web browser 
5 responsible for displaying video streams 401 received from multiple webcams. 

As explained in greater detail below, the stream display component 406 may 
arrange the ranked video streams 401 in different formats. Typically, the video 
streams 401 will be arranged in order of rank. For instance, FIG. 4 depicts one 
exemplary embodiment in which a plurality of video streams 401 are arranged in 
10 order of rank within a grid format. Alternatively, one or more highly ranked video 
streams 401 may be emphasized, as described in greater detail below. 

FIGS. 5 and 6 illustrates one possible arrangement of video streams 401 on a 
television 110 to indicate a rank or priority. For example, as depicted in FIG. 5, the 
display area of the television 110 may be divided into a number of positions 503 at 
15 which video streams 401 may be displayed. The number within each position 503 
indicates a rank or priority for that position 503. Of course, the numbers are 
provided for convenience of description only and would not normally be displayed on 
the television 110. 

In the depicted embodiment, video streams 401 displayed at positions 503 
20 near the top of the television 110 have a higher rank than video streams 401 
displayed at positions 503 near the bottom of the television 110. Likewise, video 
streams 401 displayed at positions 503 near the left-hand side of the television 110 
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have a higher rank than video streams 401 displayed at positions 503 near the right- 
hand side of the television 110. Those skilled in the art will recognize that FIG. 5 
illustrates one of many possible arrangements of video streams 401, and many 
variations thereof may be included within the scope of the invention. 

5 FIG. 6 illustrates a plurality of video streams 401a-401l being displayed at the 

positions 503 illustrated in FIG. 5. In one implementation, only video streams 401 of 
a threshold rank or higher (e.g., the nine most significant video streams 401) may be 
shown on the display screen. This may occur, for example, when there are too 
many video streams 401 to be simultaneously displayed. 

10 FIG 7. illustrates the promotion of a video stream 401 f to a higher rank, e.g., 

when a scene change is detected, when rush hour begins, etc.. In one 
implementation, other video streams 401a-401e may be demoted to accommodate 
the new rank of the video stream 401 f. In another embodiment, the promoted video 
stream 401f merely switches places with the video stream 401a it is replacing. Of 

15 course, in other embodiments, ail of the video streams 401a-401l may be re-ranked, 
resulting in more than a single change. 

As shown in FIG. 8, a video stream of highest rank 401a may be enlarged or 
otherwise highlighted to attract the attention of the user. In this embodiment, the 
remaining video streams 401 b-401 i are not necessarily displayed according to rank, 
20 although such could be the case. In alternative embodiments, a plurality of video 
streams (e.g., video streams 401a-401c) are ranked and placed in the appropriate 
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positions 503 (or enlarged), the remaining video streams 401 being arbitrarily placed 
in the remaining positions 503. 

Other methods of emphasizing the video stream(s) 401 of highest rank are 
contemplated. For example, a graphical indicator, such as an icon, border, etc., may 
be displayed near or around one or more highly-ranked video streams 401 . 

FIG. 9 illustrates an alternative arrangement of a plurality of video streams 
401a-401d in a ticker format. In one configuration, the displayed video streams 
401a-401d move across the television 110 from right to left in a carousel fashion. 
For example, when the video stream 401 d passes beyond the left-hand side of the 
television 1 10, it reappears on the right-hand side. 

Of course, the ticker format may be configured in various different ways 
without departing from the spirit and scope of the invention. For example, the video 
streams 401 may move in any direction. Moreover, more than one row or column of 
video streams 401 may move across the screen simultaneously. 

The ticker may have a beginning and ending position 902, 904. In the 
embodiment shown, an icon 906 is placed near the beginning position 902 of the 
ticker so that a user may easily identify the same. In one embodiment, the order of 
the video streams 401a-401d within the ticker indicates the ranking. For instance, 
the first video stream 401a displayed after the icon 906 may have the highest rank. 
Video streams of a lower rank 401b-401d are displayed sequentially thereafter. 
Thus, promoting a video stream 401 within a ticker may mean moving the video 
stream nearer the beginning position 902. 
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Based on the foregoing, the present invention offers numerous advantages 
over conventional systems. In particular, a user may simultaneously monitor video 
streams 401 from multiple cameras 1 14 at a single location. The video streams 401 
may be ranked and displayed in order of rank. Highly ranked video streams 401 
may be displayed in prominent positions or emphasized (e.g., enlarged). Thus, a 
user's attention is quickly drawn to video streams 401 depicting potentially significant 
events without having to focus on more than a few video streams 401 . 

While specific embodiments and applications of the present invention have 
been illustrated and described, it is to be understood that the invention is not limited 
to the precise configuration and components disclosed herein. Various 
modifications, changes, and variations which will be apparent to those skilled in the 
art may be made in the arrangement, operation, and details of the methods and 
systems of the present invention disclosed herein without departing from the spirit 
and scope of the invention. 

What is claimed is: 
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